![]() system and method for imaging biological samples disposed in culture medium
专利摘要:
SYSTEM AND METHOD FOR ACQUISITION OF IMAGE USING SUPERVISED SYNTHESIS OF HIGH QUALITY IMAGES. It is a capture system and method for image synthesis of biological samples disposed in a culture medium supported by a plate. The system has a calibration module, an image acquisition module and an image presentation module. When the system receives a culture plate for image synthesis, standard values for the plate and the culture medium are used to start image acquisition at a given time. The captured image is then used to create a pixel by pixel map of the image. The system inspects the pixel-by-pixel map for saturated pixels and the signal-to-noise ratio, and obtains a new image if the number of saturated pixels is at or above a predetermined threshold or the signal l-noise ratio for the pixel is below a predetermined threshold. From this inspection, a new photon flow value and / or exposure time is determined and a new image is captured using the new value, and the steps are repeated. When determining that (...). 公开号:BR112016017321B1 申请号:R112016017321-0 申请日:2015-01-30 公开日:2021-03-16 发明作者:Raphael R. Marcelpoil;Cedrick Orny;Didier Morel 申请人:Bd Kiestra B.V.; IPC主号:
专利说明:
CROSS REFERENCE TO RELATED ORDER [001] This application claims the benefit of the filing date of Provisional U.S. Application No. 61 / 933,426, filed on January 30, 2014, the disclosure of which is hereby incorporated by reference. BACKGROUND OF THE INVENTION [002] High Dynamic Range Imaging (HDR) is a digital imaging technique that captures a greater dynamic range between the lightest and darkest areas of an image. A process for automatically optimizing a dynamic range of pixel intensity acquired from a digital image is described in US Patent No. 7,978,258 to Christiansen et al. HDR takes several images at different exposure levels and uses an algorithm to stitch them together to create an image that has both dark and light spots, without compromising the quality of any one of them. However, HDR can present a distortion of reality, as it distorts the intensity of the image in general. Therefore, the search continues for HDR techniques that enhance contrast without distorting the intensity of the image. [003] Techniques for enhancing an image of a biological sample are described in WO 2012/152769 for Allano et al. Among the problems related to the imaging of such samples identified in Allano et al. they are: i) the size of the colonies being visualized; ii) the proximity of one colony to another; iii) the color mix of the colonies; iv) the nature of the Petri dish; and v) the nature of the culture medium; as well as other factors. [004] The proposed solution by Allano et al. for the problem of generating an image of a biological sample, it consists of preparing an original image created from the images acquired in each color, removing predetermined absorption effects for the culture medium and the culture vessel and determining a value for the flow of photons and the exposure time using a predetermined exposure to acquire an image that is then dissected in zones of brightness. From this, the brightness of the image is acquired and used to determine whether the value for the photon flow and the exposure time used was correct or whether a new value for the photon flow and the exposure time should be used for the image capture. [005] The problem with previous techniques is that they do not offer a system with the ability to provide imaging conditions that can detect very subtle changes in contrast that are necessary for the detection / identification of microbes based on images in growth medium. Since the evidence based on images of the microbes and / or their growth in the medium is (or at least can be) difficult to detect, more robust techniques are sought for the imaging of such samples. BRIEF SUMMARY OF THE INVENTION [006] Here is described a system and method that improve image capture for images with low contrast or variable contrast. An example of such a challenging imaging environment is that of bacterial colonies growing on agar growth plates. Bacterial colonies reflect light differently than agar. In addition, bacterial colonies can vary from light to dark colors and reflect light differently from agar. The time to capture an image of a colony is short (approximately one second). Typically, an image of the growth plate is acquired every 3 to 6 hours. [007] An image is acquired in a series of N image acquisitions in each “x” time interval (ie, t0, t1... Tx). The first acquisition (N = 1) uses standard values for light intensity and exposure time, here called "photon flow and exposure time". The photon flow value defines the number of photons arriving on the scene by time unit and area unit ((number of photons) • (time-1) • (area-1)). The time being the time of integration in the camera sensor. The exposure time determines the number of photons captured by the sensor for the acquisition of a frame. Put another way, the photon flux is the rate of photon flow from the light source and the exposure time influences the amount of photons received by the sensor for the image acquisition. a given flow of photons, the exposure time controls the intensity of the image. [008] An individual skilled in the art is aware of the many different ways of controlling the flow of photons to influence the intensity of the image. As noted above, a technique controls the exposure time of the image. There are other techniques that can be used to control the intensity of the light transmitted to the sensor. For example, filters, vents, etc. are used to control the flow of photons, which in turn controls the intensity. Such techniques are well known to those skilled in the art and are not described in detail here. For the purposes of the embodiments of the invention described here, the light intensity is defined as constant and the exposure time is the variable used to control the integration of the photon flow. [009] In embodiments in which the photon flow is controlled by controlling the exposure time, the initial exposure time values are acquired from the calibration of the system. The system is calibrated using a library of calibration plates. Baseline calibration is acquired depending on the type of plate and the type of medium. When the system is used to interrogate new growth plates, the calibration data for a particular plate type and media type is selected. In this regard, the growth plates can be: monoplates (that is, for a medium); biplates (two media); triplets (three media), etc. Each type of growth plate presents unique imaging challenges. Calibration provides a standard exposure time to capture the first image (image N = 1) of the growth plate. Calibration also makes it possible for the system (or system operator) to determine which parts of the image are plates (ie, not the background) and, of the plate parts of the image, which parts are the medium (the nutrients used to grow the colonies), and which parts are, at least potentially, colonies. [010] The N = 1 image of a growth plate is captured using the standard values acquired from the calibration. If an averaging technique is used to capture digital images from the growth plate, the light pixels will have a better signal-to-noise ratio (SNR) than that of the dark pixels. In the method described here, the signals are isolated for the individual pixels, regardless of whether the pixels are light or dark. For a predetermined number of pixels, the intensity, the exposure time and the SNR are determined. A “map” of these values in the context of the image is prepared. From this map, a new exposure time that preferably will not saturate more than a predetermined fraction of pixels is selected for the acquisition of N + 1 image. Preferably, an exposure time in which only a very small fraction of pixels (or less) are saturated is determined and used to capture the final image. [011] From this, a map of the SNR for each pixel where the SNR is updated (that is, the gray value is refined and the improved SNR for the unsaturated pixels) for each unsaturated pixel is generated. An image is simulated based on this map. [012] An optimization function algorithm is used to map each gray value intensity for each pixel to the corresponding necessary exposure time for the optimal SNR for the pixel. The optimization algorithm starts by looking at the initial image (N = 1), which was captured using the predetermined standard exposure time. An intensity, exposure and SNR map is generated for the entire image. The exposure time for each pixel is adjusted based on image N and another image (N + 1) is captured. As stated above, the new exposure time is chosen, which will saturate the signals from the dark parts, resulting in the overexposure of the light parts. The intensity map, the exposure map and the SNR map are updated for each pixel. This is an iterative process, and images are acquired until the maximum SNR for each pixel for the image is reached, or the maximum number of images is reached, or the maximum allocated time has been reached. [013] Essentially, the dark points remain dark, the light points remain light and the SNR is improved. The agar growth medium acts as the background for digital images. A pixel in the image that is different in some way (that is, a different intensity) from the previous images indicates either that the colony is growing or that there is contamination (for example, dust) on the plate. This technique can be used to look at multiple plates at once. [014] Since the SNR is significantly improved, it is possible to reveal details (with confidence) that could not be seen / trusted, allowing the detection of small colonies very early in the timed plate imaging. The systems and methods also provide images corresponding to an ideal exposure time that corresponds to the specific and controlled saturation on the scene or object of interest. [015] Once the image acquisition at time t0 is complete, the iterative image acquisition process is interrupted for that time interval. When the predetermined time interval from t0 to t1 has elapsed, the iterative image acquisition process is repeated until the desired confidence in the integrity of the image thus acquired has been acquired. The signal-to-noise ratio is inversely proportional to the standard deviation (ie, SNR = gv ’/ standard deviation). Therefore, an image acquisition that produces a maximum SNR per pixel (that is, a minimum standard deviation per pixel) will provide an image with a high confidence associated with a "Tx" time. For example, a high SNR image is acquired for a plate that has been incubated for four hours (T1 = 4 hours). Another high SNR image of the same plate is acquired after the plate has been incubated for an additional four hours (Tx = 8 hours). [016] Once an image associated with a subsequent time (Tx + 1) is acquired, that image (or at least the selected pixels of the image associated with an object of interest) can be compared with the image associated with the previous time ( Tx) to determine whether the subsequent image provides evidence of microbial growth and to determine further processing of the plate. BRIEF DESCRIPTION OF THE DRAWINGS [017] FIG. 1 is a schematic description of a three module system for image acquisition and presentation in accordance with an embodiment of the present invention; [018] FIG. 2 is a flow chart of the system operation for the three module system illustrated in FIG. 1; [019] FIG. 3 is a description of the functions of the calibration module illustrated in FIG. 1 for lighting calibration, optical calibration and camera calibration according to an embodiment of the present invention; [020] FIG. 4 is an illustration of the data determined from the calibration plates to calibrate the system of FIG. 1 according to one modality; [021] FIG. 5 is a description of the functions of the image acquisition module illustrated in FIG. 1 according to an embodiment of the present invention; [022] FIG. 6 is a schematic diagram of the image acquisition method using the system of FIG. 1 according to one modality; [023] FIG. 7 is a more detailed description of the functions performed by the image acquisition module illustrated in FIG. 5. [024] FIG. 8 illustrates the method for choosing the next image acquisition time according to a modality; [025] FIG. 9 is a description of the steps taken to complete the image acquisition; and [026] FIG. 10 is a schematic diagram of the process flow of how to determine the integrity of the system. DETAILED DESCRIPTION [027] The system described here is capable of being implemented in optical systems for the imaging of microbiological samples for the identification of microbes and the detection of microbial growth of such microbes. There are many commercially available systems of this type, which are not described in detail here. An example is the BD Kiestra® ReadA Compact imaging and intelligent incubation system (2nd generation BD Kiestra® incubator). Such optical imaging platforms have been commercially available for many years (originally the CamerA PrimerA from Kiestra® Lab Automation), and are therefore well known to those skilled in the art and are not described in detail here. In one embodiment, the system is a non-temporary, computer-readable medium (for example, a software program) that cooperates with an image acquisition device (for example, a camera), which offers high-quality imaging of an image through interaction to provide a maximum signal-to-noise ratio (SNR) for each pixel in the image. For each pixel and each color (for example, channel), the intensity and the exposure time are recorded and the system then predicts the next best exposure time to improve the SNR of the entire scene or the objects of interest in the scene. A person skilled in the art will appreciate that the multiple values acquired per pixel will depend on the pixels and the imaging system. For example, in an RBG imaging system, values are acquired for each channel (that is, red, green or blue). In other systems, values are acquired for different spectral bands or wavelengths. [028] Initially, the system is calibrated. Calibration of imaging systems, such as that described here, are well known to those skilled in the art. A variety of calibration approaches are known. Examples of system calibration that provide a baseline from which captured images are evaluated are described here. During calibration, calibration plates (for example, plates with medium, but without colonies) are used and the image acquisition of the system is calibrated based on the known input. A library of calibration values for each type of plate medium is created, and the calibration data used for a particular plate is selected based on the medium on the test plate. Both the system and the data are calibrated. For data calibration, SNR, Linearity, Black Level, etc. are determined. for each pixel of the image captured from the calibration plate. The calibration system includes, but is not limited to, lens distortion, chromatic aberrations, spatial resolution, etc. [029] After calibration, images of the new plates are acquired. The pixels in the image are analyzed in real time in order to estimate the exposure time that will improve the SNR of the pixels with an SNR that is below a predetermined threshold or for those pixels with the lowest SNR. Typical imaging systems only retain intensity values for the pixels in the image. In the embodiments described here, the intensity and the exposure time are recorded for each pixel. The same pixel is synthesized at different exposure times and the intensity information is combined to generate high SNR data. From that information, an image can be generated for any specified exposure time, or the best exposure time can be extracted to control pixel saturation. [030] From a quantitative aspect, thanks to the high SNR, confidence in subtle variations in intensity, colors and texture is greatly improved, allowing for better performance of subsequent object recognition or database comparison . The analysis is done on a gray scale compared to the gray value of the pixel in a previous image (that is, for the N image, the pixel value in the N-1 image). In addition to comparing the same pixel gray value in the previous image, the pixel gray value of the adjacent pixels is also compared with the pixel gray value to determine the differences (for example, the colony / medium interface). [031] The SNR of dark or colored objects is irregular in the different channels or very weak when compared to that of light objects. In order to improve this, the system and method described here implement an image detection module in which object detection is based on contrast, SNR, and size / resolution. SNR is perfected in both dark and light regions. The standard deviation is decreased, and therefore the local contrast becomes as significant in the light as it is in the dark. The goal here is to offer a system that detects even subtle differences between the x and x + 1 time interval images of a plate suspected of containing a growing culture. These differences should be distinguishable from the "noise" that results from signal variations, but not from changes in the sample that can be attributed to a growing culture. The systems and methods described here are especially valuable when the objects of interest in the scene may present very different colors and intensities (reflectance or absorbency). [032] Specifically, the system and method provide automatic adaptation of the dynamic range (extended dynamic range) to accommodate the scene. The system and method provide both the minimum exposure time to saturate the lightest pixel and the maximum exposure time to saturate the darkest pixel (within the physical and electronic restrictions of the image acquisition equipment (for example, the camera)) . The system and method provide faster convergence for a minimum SNR per pixel compared to the image average calculation. The system and method provide enhanced color confidence. Specifically, the SNR for the values of red, green and blue is homogenized, regardless of the disparities in intensity in the colors red, green and blue. [033] Intensity confidence intervals are known per pixel, which is very valuable for any subsequent classification effort. The SNR optimization offered by the system and method can be supervised (weighting of the detected objects of interest to calculate the exposure times of the next image acquisition). [034] The intensity, the exposure time and the estimated SNR are determined from the calibration and the physical theory for each pixel. To further improve image quality, chromatic aberration and lens distortion are also calibrated and corrected to make an image free from such defects. [035] The system and method can control the pixel SNR for the image in either an automatic or a supervised mode, in which certain parts of the image are of particular interest. In automatic mode, the entire image of the scene is optimized, and all pixels are treated equally. In supervised mode, the scene is further analyzed when acquired to detect the objects of interest. The maximization of the SNR favors the objects of the regions of interest. [036] In automatic mode, image acquisition will stop after the first of the following three conditions occurs: (1) a minimum SNR level is reached for each and every pixel; (2) a predetermined number of acquisitions were made in this scene; or (3) the maximum allowable acquisition time has been reached. [037] Referring to FIG. 1, a schematic view of the system of an embodiment is illustrated. System 100 has three modules. The first is a system 110 calibration module. The calibration module calibrates the image illumination, the optics used to collect the image, and the baseline data for the new plate under evaluation by the system. [038] The image acquisition module 120 is in communication with the system calibration module 110. The image acquisition module captures an image of the object under analysis. The image is captured using the exposure time and other criteria determined in a manner described in detail here later in the context of the specific examples. As discussed above, image acquisition proceeds iteratively until a predetermined SNR threshold is reached for each pixel or until a predetermined number of images has been captured. The image display module provides the image with the best dynamic range (that is, the lightest unsaturated pixels that are just below saturation), either globally (that is, in automatic mode) or restricted to objects of interest ( that is, in supervised mode). [039] Referring to FIG. 2, both external data and calibration plates (that is, the variety of combinations of test plates and culture media) are used to calibrate the system). From the calibration, both the system calibration and the data calibration are determined. The system and data calibration values are used when image acquisition for a new card. Calibration is used to validate the new image in terms of the image map (that is, which pixels are regions outside the plate, which are inside the plate, but media without colonies and which regions reveal colonies). [040] FIG. 3 additionally illustrates the specific aspects of the system equipment that are calibrated. For the lighting component (s) 111, the heating time, the intensity (À) = f (input power) and field homogeneity are determined. Again, for the test plates, the medium should be homogeneous for the applicable region (that is, the entire plate for a single plate, half of the plate for a biplane and a third of a plate for a triple plate). For optical calibration 112, alignment, chromatic aberrations and geometric distortions are determined. For camera 113 calibration, baseline levels are determined. Such baseline data are: warm-up time; linearity (fixed ratio of gray values and number of photos that reach the sensor) and black level as a function of exposure time, SNR as a function of pixel intensity; field homogeneity; chromatic aberrations; and geometric distortions, all being determined as a baseline against which the acquired image is evaluated. Such baseline data is well known to those skilled in the art and is not described in further detail. [041] FIG. 4 shows additional details about the entries in the calibration systems (ie system information, the library of calibration plates and other entries). For each calibration plate, an image is acquired and each pixel is assigned values for black level, SNR, linearity and lighting. For the system (that is, not pixel by pixel), model values that reflect system factors, such as distortion, chromatic aberrations, spatial resolutions and white balance are determined. All of these values are collected to provide a calibrated system and calibrated data for use in plate evaluation. As noted below, these values are used to finalize image acquisition. [042] More details on the image acquisition module are described in FIG. 5. In the first step, an image is acquired using default values. From that first image, the intensity, the exposure time and the SNR for each pixel are determined. The intensity is determined by subtracting the “black level” for the pixel from a measured intensity value. The black level and the SNR are acquired from the calibration described previously. [043] Image acquisition occurs in times to, ti, ... tx. Each time, an image is acquired through a series of N image acquisitions. The N series of image acquisitions iterates over an SNR to the acquired image that correlates with high confidence in image integrity. [044] Image acquisition at a given time (for example, to) and update is illustrated in FIG. 6. The image of a new 6io plate is acquired in step 62o. Image acquisition is informed by the calibration of the 63o system and 64o data. Plate traffic conditions (that is, number of plates per unit of time) are also used to calibrate and control the system. At a later point in time during the image acquisition process, a subsequent image is acquired 65o and compared with the previous image (both automatically and in a supervised manner). Typically, there will be approximately four to approximately ten image acquisitions in each time frame to acquire an image with acceptable confidence. Once the desired SNR for the selected object is acquired, the exposure time is determined for the acquisition of the final image 66 °. [045] According to one modality, the pixels are updated as follows. The gray value, the reference exposure time and the signal-to-noise ratio represent the information stored for each lighting configuration (top, side, bottom, or a mixture of them) per plate (image object). This information is updated after each new purchase. To begin with, this information is updated using the first image acquisition (N = i). [046] The gray value, the reference exposure time and the signal-to-noise ratio represent the information stored for each lighting configuration (top, side, bottom, or a mixture of them) per plate. This information is updated after each new purchase. To begin with, this information is initialized according to the first image acquisition (N = 1). In one mode, i is a gray value (gv) at the image position (x, y) corresponding to the 1st image capture (N = 1) of the plate using the exposure time and the respective Signal-to-Noise Ratio (- ■ '“:; - •). In this mode: • 5. is the black reference point at (x, y) corresponding to the exposure time; • ^ * is the reference time point updated at (x, y) after 1 acquisition; • ^ .. is the gray value updated at x, y after 1 acquisition in the equivalent exposure time ~. i; •>-'- .. - .1 is the SNR updated at x, y after 1 acquisition; [047] The black level is noisy and the iterative image acquisition process obtains an image that is "less noisy" (that is, an image with a higher level of confidence). The black value is a standard value that is not recalculated during image acquisition. The black value is a function of the exposure time. [048] SNR = 0 when a pixel is saturating for a given exposure time (therefore, no improvement in SNR) and light source intensity. Only the values of the unsaturated pixels are updated. [049] N = 1: The initial exposure time is the best known standard exposure time (a priori), or an arbitrary value (for example: (Max exposure time + Min exposure time) / 2). This is determined from the calibration for the plate and medium in particular for the new plate under analysis. [050] The gray value, the reference exposure time and the signal-to-noise ratio are updated after each new image acquisition (ie, N = 2, 3, 4.. N) according to the following modality . The gray value s'- for the image position (x, y) corresponds to the umpteenth image capture of the plate using the exposure time and the respective Signal-to-Noise Ratio (J - ■. ■). In this mode: • it is the black reference point at (x, y) corresponding to the exposure time; ': ■ :; • ^ is the reference time point updated at (x, y) after N acquisitions; • is the gray value updated in (x, y) after N acquisitions in the equivalent exposure time - ■. ■; and •>-'- is the SNR updated at x, y after N acquisitions. [051] Therefore, the updated SNR for a pixel in the umpteenth image acquisition is the square root of the updated signal-to-noise ratio squared of the current image acquisition. Each acquisition provides an updated value (for example, E’x, y, N) for each pixel. This updated value is then used to calculate the updated value for the next image acquisition. SNR = 0 for a pixel when a pixel is saturating for a given exposure time and intensity of the light source. Only unsaturated pixels are ‘updated. The umpteenth exposure time corresponds to a supervised optimization, whose objective is to maximize the SNR for the objects of interest. The object of interest can be the entire plate, the colonies, a part of the plate or the entire image. [052] After updating the image data with a new acquisition, the acquisition system is able to propose the next best acquisition time that would maximize SNR according to environmental restrictions (minimum required SNR, saturation restrictions, acquisition time maximum allowed, region of interest). In embodiments in which the image acquisition is supervised: x, y AND the object implies that, in the supervised mode, the pixels of the object are only considered for evaluations. In those embodiments where image acquisition is not supervised, the standard object is the entire image. [053] With reference to FIG. 7, from the analysis of the acquired image, the exposure time for the next image (N + 1) in the image acquisition series in a given time interval is determined using either the automatic mode or the supervised mode described above. Referring to FIG. 7, for the automated process, each pixel is weighted equally (that is, a value of 1 is designated). For the supervised approach, pixels associated with objects (for example, cultures) are weighted differently. The supervised process requires additional imaging steps. If a significant fraction (for example, greater than 1 in 100,000) of pixels is saturating and their weights are not equal to 0, then a new exposure time is proposed that is shorter (for example, 1/5) than the previous minimum exposure time used to capture the image. This adjustment improves the probability of acquiring unsaturated information for the saturated pixels. In alternative embodiments, a new exposure time is calculated. If there is no significant pixel saturation, then, for each pixel, from the exposure and intensity map, the maximum exposure time that will not result in pixel saturation is determined. From this, an exposure time for the image is determined, and an image of intensity is simulated. From there, the corresponding weighted SNR map is determined. [054] Referring to FIG. 8, the sample image is used to update the image data, pixel by pixel, on the image map. This sample data is then fed to the image analyzer and the image analysis is performed informed by predetermined restrictions in the SNR for each pixel, other saturation restrictions, object restrictions, etc. and time or traffic restrictions (ie, duration of capture and analysis). [055] In a specific modality, the acquired image is analyzed pixel by pixel in search of saturated pixels. If EN results in a pixel saturation that exceeds predetermined limits, a lower value for EN + 1 is selected. For example, the minimum exposure time has not been acquired yet and the percentage of saturated pixels (* v xy, NE. (Xv V ■ '' = çr.jat) exceeds the predetermined limit (for example> 1/105) a new exposure time is proposed in a predetermined increment (for example, one fifth of the minimum exposure time previously used. The lower limit (ie the minimum acceptable exposure time) is also predetermined. These restrictions on exposure time allow for convergence faster for image acquisition conditions without saturation. [056] A new image is acquired in the new exposure time. For the new image, the secondary checked restrictions are the desired minimum SNR per pixel (this is the lower SNR threshold) and the overall acquisition time (or Nmax) allowed for that image. If the overall acquisition time for this scene has reached the time limit, or if each updated SNR for each pixel is such that s then the image data is considered acceptable and the scene acquisition ends for the time interval (for example , t0). When image acquisition starts at time tx (for example, t1), the best exposure time (ENfinal) leading to under-saturation conditions from the previous acquisition exposure (for example, at time t0) is used as the initial value for E. The process for image acquisition in tx is, in other cases, identical to the process in time to. [057] If the saturation constraint is lifted (no significant saturation), the next optimal exposure time is determined and investigated. First, the exposure time limits are calculated on the region of interest. These exposure time limits are: I) the exposure time to saturate the lightest pixels; and ii) the exposure time to saturate the darkest pixels. [058] The exposure time to saturate the lighter unsaturated pixels,, is determined from the gray value that corresponds to the absolute maximum intensity and Es- „, (its related exposure time) from the following: [059] The exposure time to saturate the lighter unsaturated pixels,, is determined from the gray value that corresponds to the absolute maximum intensity and (its related exposure time) from the following: [060] The next ideal exposure time is chosen from among all candidate exposure times within Emax and Emin by simulation. Specifically, an exposure time is determined by simulation that will maximize the updated average SNR (for all pixels below the minimum signal-to-noise ratio threshold), after adding the simulated image at the tested exposure time ^ = -.- :, .-i. The simulated image is generated as follows (for each and every pixel). gv 't [061] The gray value "• -. Is pixel data corresponding to the current updated image data. If a new E∑es∑xi time point is selected, the expected gray value is: [062] After updating this heat with a value for the pixel from the simulated image in the image at the time point, the SNR for this pixel (x, y) will be: [063] The next best exposure time is then determined by: If image acquisition and analysis is supervised x, y and object, the SNR is integrated only for the objects of interest. ' In automatic mode, the object is the entire yacht. [064] FIG. 9 describes the final steps for image acquisition. These steps are conventional image processing techniques well known to those skilled in the art and are not described in detail here. [065] FIG. 10 illustrates the method by which the integrity of the systems is determined during image acquisition. Note that once the integrity of the system is verified, samples are loaded into the system and sample data is captured. The data capture is informed by the calibration information, as discussed above. The captured data is provided for both the system integrity check and a system event analyzer. [066] Once the image has been acquired as described above, it is compared to an image of the plate that has been incubated for a different period of time. For example, an image of a plate is acquired as described here after the plate has been incubated for four hours (T1 = 4). After four or more hours, another image of the plate is acquired as described above (Tx = 8 hrs). The high SNR image acquired at Tx + 1 can then be compared with the high SNR image at tX. The changes in the two images are evaluated to ascertain evidence of microbial growth. Decisions about further processing (for example, the plate is positive, the plate is negative, the plate requires additional incubation) are based on this comparison. [067] Although the invention presented here has been described with reference to specific embodiments, it should be understood that these embodiments are merely illustrative of the principles and applications of the present invention. Therefore, it should be understood that several modifications can be made to the illustrative modalities and that other configurations can be designed without departing from the spirit and scope of the present invention, as defined by the appended claims.
权利要求:
Claims (14) [0001] 1. System for imaging biological samples disposed in culture medium, the system FEATURED for comprising: a system calibration module that provides standard values for capturing an image of a biological sample disposed in culture medium disposed on a plate; an image acquisition module comprising a camera, in which the image acquisition module is adapted to acquire data for a series of images in a given time interval, in communication with the system calibration module, the configured image acquisition to: i) acquire data for a first image using standard values for photon flow and exposure time from the system calibration module and create a pixel by pixel map of the image data, each pixel associated with a signal-to-noise ratio (SNR), a photon flow and exposure time, and an intensity, ii) update the image acquisition time by analyzing image data to identify saturated pixels and select one from a new photon flow, a new one exposure time, or both, based on whether a ratio of saturated to unsaturated pixels is greater or less than a predetermined saturation threshold and, based on this determination, iii) use the new value for the flow d and photons, the exposure time, or both, to acquire data for a new image, and iv) update the image data map with the new values for the signal-to-noise ratio, the photon flow, the exposure time, or both, and the pixel intensity, at which the image acquisition module is configured to acquire data for a new image if the signal-to-noise ratio of the unsaturated pixels is less than a predetermined SNR threshold or if the number of pixels saturates exceed the predetermined saturation threshold, in which the image acquisition module finalizes the image acquisition when the signal-to-noise ratio of unsaturated pixels satisfies or exceeds the predetermined SNR threshold, a predetermined allocated time for image acquisition has elapsed, or a predetermined maximum number of images has been acquired; and an image presentation module that transforms the image data from the image acquisition module into an image for viewing or analysis. [0002] 2. System, according to claim 1, CHARACTERIZED by the fact that the photon flow is a defined value and the system controls a camera sensor integration by controlling the exposure time, in which the calibration module determines flow of standard photons and exposure time for a variety of plates and culture media. [0003] 3. System, according to claim 1, CHARACTERIZED by the fact that the signal-to-noise ratio is determined for at least part of the sample image arranged in the culture medium. [0004] 4. System, according to claim 1, CHARACTERIZED by the fact that the image acquisition module acquires image data from the camera for at least one or more channels or one or more spectral bands. [0005] 5. System, according to claim 1, CHARACTERIZED by the fact that the image acquisition module assigns a gray value for each pixel for each image acquisition, and the gray value for each pixel is updated after each image acquisition. Image. [0006] 6. System, according to claim 5, CHARACTERIZED by the fact that the updated gray value is the previous gray value minus a predetermined reference value, where the predetermined reference value is a predetermined value based on the plate, the plate medium and the exposure time for the image acquisition module assign a gray value for each pixel for each acquisition, and the gray value for each pixel is updated after each image acquisition. [0007] 7. System, according to claim 2, CHARACTERIZED by the fact that the new value for the photon flow is acquired using a new exposure time or a new light intensity value, or both. [0008] 8. System, according to claim 1, CHARACTERIZED by the fact that the image acquisition module is configured to operate in at least one among an automatic mode where all pixels are treated equally or a supervised mode, where the analyzed pixels are those that have been identified as associated with one or more objects of interest. [0009] 9. System, according to claim 1, CHARACTERIZED by the fact that the photon flow is a defined value and the system controls a camera sensor integration by controlling the exposure time. [0010] 10. Method for imaging biological samples disposed in culture medium, the CHARACTERIZED method for understanding: determining standard values to acquire an image of a biological sample disposed in culture medium supported on a plate; acquire data corresponding to a series of images in a first time during a first time interval, the data of the first image in the series being acquired using predetermined patterns for photon flow and exposure time; create a pixel by pixel map of the image data; associate data for each pixel with a signal-to-noise ratio (SNR), a value for photon flow, exposure time, and an intensity; update at least one of the image photon flow value and the exposure time value by: i) analyzing the image data for saturated pixels and the signal-to-noise ratio for the pixels, and selecting a new value for at least one of the photon flux and exposure time based on whether a ratio of saturated to unsaturated pixels is greater or less than a predetermined threshold and whether the signal-to-noise ratio of unsaturated pixels meets or exceeds a predetermined SNR threshold and, based on this determination, use the new value for photon flow, exposure time, or both, to acquire a new image and update the image map with the new values for signal-to-noise ratio, photon flow and time of exposure, and pixel intensity, ii) acquire data for the new image using at least one new value for photon flow and exposure time, and iii) optionally, repeat steps i) and ii); finalize the acquisition of image data for the time interval when the image data is at or above the predetermined SNR threshold, a predetermined maximum allocated time for image acquisition has elapsed, or a predetermined maximum number of images has been acquired; repeat the steps of acquiring, creating, associating, updating and finalizing for a second time during a second time interval; and transform the image data acquired in the first and second time intervals into the first and second images, the first image acquired in the first time and the second image acquired in a second time. [0011] 11. Method, according to claim 10, CHARACTERIZED by the fact that the value for photon flow is constant and the exposure time value updated, and in which the predetermined standard values are based on plate, plate culture and time exposure. [0012] 12. Method, according to claim 10, CHARACTERIZED by additionally comprising determining the pixels for which the image map will be created, in which the pixels are associated with an object of interest. [0013] 13. Method, according to claim 12, CHARACTERIZED by the fact that the standard values comprise a black level for the pixels associated with an object of interest at a standard exposure time. [0014] 14. Method, according to claim 10, CHARACTERIZED by the fact that the pixel by pixel map is a gray value, the signal-to-noise ratio and the exposure time for each pixel.
类似技术:
公开号 | 公开日 | 专利标题 BR112016017321B1|2021-03-16|system and method for imaging biological samples disposed in culture medium JP2019124695A|2019-07-25|Systems and methods for calibrating, configuring and validating imaging device or system for multiplex tissue assays JP5997185B2|2016-09-28|Method and software for analyzing microbial growth AU2012242996B2|2015-08-13|Method for preparing quantitative video-microscopy and associated system WO2003025554A2|2003-03-27|Method quantitative video-microscopy and associated system and computer software program product BRPI0610115B1|2019-11-26|METHOD OF COLORING A SAMPLE FOR MICROSCOPIC IMAGE FORMATION, METHOD OF ARTIFICALLY COLORING A SAMPLE, METHOD OF OBTAINING A SAMPLE, METHOD OF SELECTING A DETERMINATION OF A DYNAMIC INTERESTING METHODS AND METHOD OF SEPARATION OF CHROMOGENS FOR COLORING BIOLOGICAL SAMPLING JP5833631B2|2015-12-16|Method for setting one or more ranges of one or more inspection parameters in an optical inspection system JP5576993B2|2014-08-20|Image measuring apparatus, image measuring method, and image measuring system JP2020534847A|2020-12-03|Methods and systems for automatic assessment of antibiotic susceptibility JP7036858B2|2022-03-15|Systems and methods for imaging biological samples RU2462195C2|2012-09-27|Method of examination and diagnostics of condition of biological object or its part Korzynska et al.2016|Color standardization for the immunohistochemically stained tissue section images Saafin et al.2017|Pre-processing techniques for colour digital pathology image analysis WO2021014682A1|2021-01-28|Particle quantitative measurement device AU2007249081A1|2008-01-10|Method quantitative video-microscopy and associated system and computer software program product
同族专利:
公开号 | 公开日 US10200625B2|2019-02-05| WO2015114121A1|2015-08-06| CN111263076A|2020-06-09| CA2936961C|2018-11-13| CN105960586B|2020-03-03| EP3100025B1|2021-03-03| US20190116303A1|2019-04-18| JP6687524B2|2020-04-22| AU2020200895A1|2020-02-27| ES2867811T3|2021-10-20| CA2936961A1|2015-08-06| US10841503B2|2020-11-17| MX364965B|2019-05-15| US20170013181A1|2017-01-12| AU2015212758A1|2016-08-11| EP3851832A1|2021-07-21| AU2020200895B2|2021-04-29| JP2020115148A|2020-07-30| EP3100025A1|2016-12-07| ZA201604925B|2020-02-26| JP2017505905A|2017-02-23| CN105960586A|2016-09-21| MX2016009829A|2016-10-31| CN111263076B|2021-06-18| AU2015212758B2|2019-11-21|
引用文献:
公开号 | 申请日 | 公开日 | 申请人 | 专利标题 US4700298A|1984-09-14|1987-10-13|Branko Palcic|Dynamic microscope image processing scanner| US4724215A|1985-02-27|1988-02-09|Sherwood Medical Company|Automated microbiological testing apparatus and method| JP3396237B2|1992-06-08|2003-04-14|セイコーインスツルメンツ株式会社|Spectrometer| CA2138272A1|1992-07-13|1994-01-20|Steven P. Floeder|A technique to count objects in a scanned image| US5723308A|1993-05-14|1998-03-03|Minnesota Mining And Manufacturing Company|Culture medium for rapid count of coliform bacteria| JP3749933B2|1993-05-14|2006-03-01|スリーエムカンパニー|Method for rapid quantification of microbial growth| FR2719602B1|1994-05-05|1996-07-26|Biocom Sa|Method and installation for the digitization of cells and microorganisms, in particular food products or biological fluids.| US5978497A|1994-09-20|1999-11-02|Neopath, Inc.|Apparatus for the identification of free-lying cells| US5694478A|1994-12-15|1997-12-02|Minnesota Mining And Manufacturing Company|Method and apparatus for detecting and identifying microbial colonies| US7117098B1|1997-02-27|2006-10-03|Cellomics, Inc.|Machine-readable storage medium for analyzing distribution of macromolecules between the cell membrane and the cell cytoplasm| US6122396A|1996-12-16|2000-09-19|Bio-Tech Imaging, Inc.|Method of and apparatus for automating detection of microorganisms| GB9714347D0|1997-07-09|1997-09-10|Oxoid Ltd|Image analysis systems and devices for use therewith| JP4286447B2|1997-08-07|2009-07-01|ジーイー・ヘルスケア・ナイアガラ・インク|Digital imaging system for assays in well plates, gels and blots| CA2322072A1|1998-12-28|2000-07-06|Sapporo Breweries Ltd.|Method of apparatus for enumerating microbes by counting luminous points on a digitized pixilated image| US8131053B2|1999-01-25|2012-03-06|Amnis Corporation|Detection of circulating tumor cells using imaging flow cytometry| US6153400A|1999-03-12|2000-11-28|Akzo Nobel N.V.|Device and method for microbial antibiotic susceptibility testing| US6453060B1|1999-06-29|2002-09-17|Tri Path Imaging, Inc.|Method and apparatus for deriving separate images from multiple chromogens in a branched image analysis system| IL132687D0|1999-11-01|2001-03-19|Keren Mechkarim Ichilov Pnimit|System and method for evaluating body fluid samples| US7065242B2|2000-03-28|2006-06-20|Viewpoint Corporation|System and method of three-dimensional image capture and modeling| BR0003066A|2000-07-21|2002-04-30|Fundacao Oswaldo Cruz|Method and device for detecting microorganisms using optical fiber| GB0107155D0|2001-03-22|2001-05-09|Finecard Internat Ltd|A play tunnel| EP1417632A1|2001-05-29|2004-05-12|Tissueinformatics, Inc.|Robust stain detection and quantification for histological specimens based on a physical model for stain absorption| US7863552B2|2001-07-06|2011-01-04|Palantyr Research Llc|Digital images and related methodologies| ES2430854T3|2001-09-06|2013-11-22|Rapid Micro Biosystems, Inc.|Rapid detection of cells in replication| US7065236B2|2001-09-19|2006-06-20|Tripath Imaging, Inc.|Method for quantitative video-microscopy and associated system and computer software program product| US6605446B2|2001-10-18|2003-08-12|Gideon Eden|Detecting airborne microorganisms| IL162908D0|2002-01-15|2005-11-20|Yissum Res Dev Co|System and method for compressing the dynamic range of an image| US7133547B2|2002-01-24|2006-11-07|Tripath Imaging, Inc.|Method for quantitative video-microscopy and associated system and computer software program product| US6884983B2|2002-06-10|2005-04-26|Palantyr Research, Llc|Imaging system for examining biological material| US20040102903A1|2002-11-27|2004-05-27|Graessle Josef A.|Biological growth plate scanner| US7351574B2|2002-11-27|2008-04-01|3M Innovative Properties Company|Loading and ejection systems for biological growth plate scanner| MXPA05005489A|2002-11-27|2005-08-16|3M Innovative Properties Co|Biological growth plate scanner.| WO2004051267A2|2002-11-27|2004-06-17|3M Innovative Properties Company|Loading and ejection systems for biological growth plate scanner| US7319031B2|2002-11-27|2008-01-15|3M Innovative Properties Company|Mounting platform for biological growth plate scanner| US20040101954A1|2002-11-27|2004-05-27|Graessle Josef A.|Back side plate illumination for biological growth plate scanner| WO2004069409A2|2003-01-31|2004-08-19|Discovery Partners International|Automated sample analysis system and method| US20040253660A1|2003-06-12|2004-12-16|Giles Scientific, Inc.|Automated microbiological testing apparatus and method| US7687239B2|2003-07-12|2010-03-30|Accelrs Technology Corporation|Sensitive and rapid determination of antimicrobial susceptibility| US7341841B2|2003-07-12|2008-03-11|Accelr8 Technology Corporation|Rapid microbial detection and antimicrobial susceptibility testing| US7496225B2|2003-09-04|2009-02-24|3M Innovative Properties Company|Biological growth plate scanner with automated intake| US7298886B2|2003-09-05|2007-11-20|3M Innovative Properties Company|Counting biological agents on biological growth plates| US7623728B2|2004-03-24|2009-11-24|General Electric Company|Method and product for processing digital images| US7854705B2|2004-12-16|2010-12-21|Olga Pawluczyk|Ex vivo verification of biopsy tissue samples| US7060955B1|2005-01-31|2006-06-13|Chemimage Corporation|Apparatus and method for defining illumination parameters of a sample| CA2600934A1|2005-03-07|2006-09-14|Novx Systems Inc.|Automated analyzer| CN1703079A|2005-04-11|2005-11-30|浙江大学|Adaptive dynamic range expanded imaging method and apparatus| EP1882237A2|2005-05-13|2008-01-30|Tripath Imaging, Inc.|Methods of chromogen separation-based image analysis| US7732743B1|2005-06-03|2010-06-08|Michael Paul Buchin|Low-photon-flux image acquisition and processing tool| US7796815B2|2005-06-10|2010-09-14|The Cleveland Clinic Foundation|Image analysis of biological objects| US8131477B2|2005-11-16|2012-03-06|3M Cogent, Inc.|Method and device for image-based biological data quantification| FI20051329A0|2005-12-27|2005-12-27|Wallac Oy|Apparatus and method for optical measurement of samples| JP4899523B2|2006-02-20|2012-03-21|日本電産株式会社|Centrifugal fan| US8428331B2|2006-08-07|2013-04-23|Northeastern University|Phase subtraction cell counting method| US7884869B2|2007-04-30|2011-02-08|Motorola Mobility, Inc.|Assignment of pixel element exposure times in digital camera modules and mobile communication devices| JP5188101B2|2007-06-01|2013-04-24|株式会社キーエンス|Magnification observation apparatus, magnified image photographing method, magnified image photographing program, and computer-readable recording medium| JP4863932B2|2007-06-04|2012-01-25|株式会社エヌテック|Counting the number of colonies| WO2009029810A1|2007-08-31|2009-03-05|Historx, Inc.|Automatic exposure time selection for imaging tissue| US9012209B2|2008-01-17|2015-04-21|Neogen Corporation|CO2 optical sensor for detection and enumeration of microorganisms| WO2009111301A1|2008-03-04|2009-09-11|3M Innovative Properties Company|Information management in automated processing of biological growth media| EP2653852B1|2008-03-26|2018-04-25|3M Innovative Properties Company|Spectral analysis of biological growth media| CN104939806B|2008-05-20|2021-12-10|大学健康网络|Apparatus and method for fluorescence-based imaging and monitoring| AU2009293380B2|2008-09-16|2016-05-19|Novartis Ag|Reproducible quantification of biomarker expression| US9150900B2|2009-05-15|2015-10-06|Biomerieux, Inc.|Automated transfer mechanism for microbial detection apparatus| EP2438554B1|2009-06-01|2020-04-01|Bio-Rad Laboratories, Inc.|Calibration of imaging device for biological/chemical samples| US8570370B2|2009-08-31|2013-10-29|Bio-Rad Laboratories, Inc.|Compact automated cell counter| MX2012006547A|2009-12-08|2012-07-04|3M Innovative Porperties Company|Illumination apparatus and methods for a biological growth plate scanner.| FR2958298B1|2010-04-06|2014-10-17|Commissariat Energie Atomique|METHOD FOR DETECTING AMAS FROM BIOLOGICAL PARTICLES| TWI420413B|2010-07-15|2013-12-21|Chunghwa Picture Tubes Ltd|Depth map enhancing method and computer-readable medium therefor| US8818069B2|2010-11-30|2014-08-26|General Electric Company|Methods for scaling images to differing exposure times| CN102590087B|2011-01-10|2015-11-25|伊鲁米那股份有限公司|For the formation method of the sample that biological or chemical is analyzed| FR2971846B1|2011-02-21|2013-12-06|Commissariat Energie Atomique|METHOD OF OBSERVING A SAMPLE| KR101917404B1|2011-03-04|2019-01-24|엘비티 이노베이션스 리미티드|Colour calibration method for an image capture device| EP2681715A4|2011-03-04|2014-10-08|Lbt Innovations Ltd|Method and software for analysing microbial growth| WO2012119190A1|2011-03-04|2012-09-13|Lbt Innovations Limited|Image capture and lighting apparatus| CN103534711B|2011-03-04|2018-08-07|Lbt创新有限公司|Method for the classification results for improving grader| EP2520923A1|2011-05-06|2012-11-07|bioMérieux|Bio-imaging method and system| JP2013066142A|2011-08-31|2013-04-11|Sony Corp|Image processing apparatus, image processing method, and program| EP2578693A1|2011-10-07|2013-04-10|Koninklijk Instituut voor de Tropen|Method for detecting bacteria| US10475527B2|2012-03-22|2019-11-12|Biomerieux, Inc.|Method and system for detection of microbial growth in a specimen container| EP2889366A4|2012-08-23|2016-04-27|Dainippon Printing Co Ltd|Culture medium information registration system, colony detection device, program, and health management system| GB201216661D0|2012-09-18|2012-10-31|Spicer Consulting Ltd|photobioreactor| FR2997502B1|2012-10-29|2014-12-26|Commissariat Energie Atomique|METHOD FOR OBSERVING BIOLOGICAL SPECIES| EP2731051A1|2012-11-07|2014-05-14|bioMérieux|Bio-imaging method| WO2014099643A1|2012-12-20|2014-06-26|3M Innovative Properties Company|Method of differentiating microbial colonies in an image| US20140177494A1|2012-12-21|2014-06-26|Alexander W. Min|Cloud-aware collaborative mobile platform power management using mobile sensors| FR3001227B1|2013-01-21|2015-02-27|Biomerieux Sa|MEANS, METHOD AND COMPUTER PROGRAM PRODUCT FOR DETERMINING THE CONCENTRATION RATE OF MICROORGANISMS DURING FLUID ANALYSIS| US9677109B2|2013-03-15|2017-06-13|Accelerate Diagnostics, Inc.|Rapid determination of microbial growth and antimicrobial susceptibility| CN203385649U|2013-03-20|2014-01-08|上海交通大学|Automatic imaging system for large-scale biological tissue serial section| ITMI20130692A1|2013-04-26|2014-10-27|Copan Italia Spa|DEVICE AND PROCEDURE FOR THE AUTOMATIC PROCESSING OF CROP PLATES FOR MICROBIOLOGICAL SAMPLES| AU2014270403B2|2013-05-23|2018-07-05|bioMérieux|Method, system and computer program product for improving the quality of an image| JP2017502673A|2014-01-03|2017-01-26|コパン イタリア エス.ピー.エー|Apparatus and method for treating diagnostic information relating to a sample of microbial material| FR3020485A1|2014-04-25|2015-10-30|Biomerieux Sa|METHOD, SYSTEM AND COMPUTER PROGRAM PRODUCT FOR DISPLAYING AN IMAGE OF AN OBJECT| FR3021054B1|2014-05-14|2016-07-01|Biomerieux Sa|METHOD AND SYSTEM FOR OBSERVING BIOLOGICAL SPECIES ON A CULTURE MEDIUM| FR3022916B1|2014-06-30|2018-04-06|Biomerieux|METHOD FOR DETECTING A PRESENCE OR ABSENCE OF BIOLOGICAL PARTICLES| DK3171765T3|2014-07-24|2021-11-01|Univ Health Network|COLLECTION AND ANALYSIS OF DATA FOR DIAGNOSTIC PURPOSES| US9347082B2|2014-08-28|2016-05-24|Omnivision Technologies, Inc.|Automated cell growth/migration detection system and associated methods| FR3028866B1|2014-11-26|2018-03-09|bioMérieux|METHOD, SYSTEM AND COMPUTER PROGRAM PRODUCT FOR DETERMINING THE GROWTH OF MICROORGANISMS| FR3030749B1|2014-12-19|2020-01-03|Commissariat A L'energie Atomique Et Aux Energies Alternatives|METHOD OF IDENTIFYING BIOLOGICAL PARTICLES BY STACKS OF DEFOCALIZED HOLOGRAPHIC IMAGES| WO2016172388A2|2015-04-21|2016-10-27|Joseph Paul Robinson|Culture detection and measurement over time| FR3038620B1|2015-07-09|2019-05-24|Biomerieux|METHOD FOR DETECTING A PRESENCE OR ABSENCE OF AT LEAST ONE FIRST INHIBITION AREA|DK3171765T3|2014-07-24|2021-11-01|Univ Health Network|COLLECTION AND ANALYSIS OF DATA FOR DIAGNOSTIC PURPOSES| CA2985848A1|2015-04-23|2016-10-27|Bd Kiestra B.V.|Colony contrast gathering| US10696938B2|2015-04-23|2020-06-30|Bd Kiestra B. V.|Method and system for automated microbial colony counting from streaked sample on plated media| WO2016191646A2|2015-05-28|2016-12-01|Bd Kiestra B.V.|Automated method and system for obtaining and preparing microorganism sample for both identification and antibiotic susceptibility tests| US10523874B2|2016-02-16|2019-12-31|Sony Corporation|Image processing apparatus, image processing method, and program| CA3077109A1|2017-09-28|2019-04-04|Bd Kiestra B.V.|Methods and systems for automated assessment of antibiotic sensitivity| CA3077590A1|2017-10-05|2019-04-11|Becton, Dickinson And Company|Application development environment for biological sample assessment processing| WO2020129066A1|2018-12-20|2020-06-25|Tracxone Ltd.|System and method for classifier training and retrieval from classifier database for large scale product identification| BR112021011795A2|2018-12-20|2021-08-31|Bd Kiestra B.V.|SYSTEM AND METHOD TO MONITOR BACTERIAL GROWTH OF BACTERIAL COLONIES AND PREDICT COLON BIOMASS| EP3709628B1|2019-03-14|2020-12-23|Axis AB|Control of an illuminator| CN110809122A|2019-11-11|2020-02-18|中国电子科技集团公司第四十四研究所|Dynamic expansion method applied to CMOS image sensor| WO2022028694A1|2020-08-05|2022-02-10|Leica Microsystems Cms Gmbh|Method for adjusting the illumination in a fluorescence microscope, and corresponding fluorescence microscope| CN112764358A|2020-12-28|2021-05-07|中国人民解放军战略支援部队航天工程大学|Dynamic control method for optical observation exposure time of geosynchronous orbit target|
法律状态:
2020-05-26| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]| 2021-01-26| B09A| Decision: intention to grant [chapter 9.1 patent gazette]| 2021-02-23| B09W| Correction of the decision to grant [chapter 9.1.4 patent gazette]|Free format text: RETIFIQUE-SE, POR ERRO MATERIAL DA REIVINDICACAO 1 DO QUADRO ANTERIOR | 2021-03-16| B16A| Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 30/01/2015, OBSERVADAS AS CONDICOES LEGAIS. |
优先权:
[返回顶部]
申请号 | 申请日 | 专利标题 US201461933426P| true| 2014-01-30|2014-01-30| US61/933,426|2014-01-30| PCT/EP2015/052017|WO2015114121A1|2014-01-30|2015-01-30|A system and method for image acquisition using supervised high quality imaging| 相关专利
Sulfonates, polymers, resist compositions and patterning process
Washing machine
Washing machine
Device for fixture finishing and tension adjusting of membrane
Structure for Equipping Band in a Plane Cathode Ray Tube
Process for preparation of 7 alpha-carboxyl 9, 11-epoxy steroids and intermediates useful therein an
国家/地区
|